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Abstract. This is a survey on the computational complexity of nonlinear mixed- 
integer optimization. It highlights a selection of important topics, ranging from incom- 
putability results that arise from number theory and logic, to recently obtained fully 
polynomial time approximation schemes in fixed dimension, and to strongly polynomial- 
time algorithms for special cases. 

1. Introduction. In this survey we study the computational com- 
plexity of nonlinear mixed-integer optimization problems, i.e., models of 
the form 

max/min f(xi,...,x n ) 

s.t. gi(xi,...,x n ) < 

: (1.1) 

g m (xi,. . .,x n ) < 
x e R™ x Z" 2 , 

where ri\ + «2 = n and f,gi,---,g m - l n — > R are arbitrary nonlinear 
functions. 

This is a very rich topic. From the very beginning, questions such 
as how to present the problem to an algorithm, and, in view of possible 
irrational outcomes, what it actually means to solve the problem need to 
be answered. Fundamental intractability results from number theory and 
logic on the one hand and from continuous optimization on the other hand 
come into play. The spectrum of theorems that we present ranges from 
incomputability results, to hardness and inapproximability theorems, to 
classes that have efficient approximation schemes, or even polynomial-time 
or strongly polynomial-time algorithms. 

We restrict our attention to deterministic algorithms in the usual bit 
complexity (Turing) model of computation. Some of the material in the 
present survey also appears in }31j . For an excellent recent survey focusing 
on other aspects of the complexity of nonlinear optimization, including 
the performance of oracle-based models and combinatorial settings such as 
nonlinear network flows, we refer to Hochbaum [34]. We also do not cover 
the recent developments by Onn et al. pTH13lf2Tl - f23|l32p44|l45] in the context 
of discrete convex optimization, for which we refer to the monograph |53j . 
Other excellent sources are [TB] and [55] , 
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2. Preliminaries. 

2.1. Presentation of the problem. We restrict ourselves to a model 
where the problem is presented explicitly. In most of this survey, the func- 
tions / and gi will be polynomial functions presented in a sparse encoding, 
where all coefficients are rational (or integer) and encoded in the binary 
scheme. It is useful to assume that the exponents of monomials are given 
in the unary encoding scheme; otherwise already in very simple cases the 
results of function evaluations will have an encoding length that is expo- 
nential in the input size. 

In an alternative model, the functions are presented by oracles, such 
as comparison oracles or evaluation oracles. This model permits to handle 
more general functions (not just polynomials), and on the other hand it is 
very useful to obtain hardness results. 

2.2. Encoding issues for solutions. When we want to study the 
computational complexity of these optimization problems, we first need to 
discuss how to encode the input (the data of the optimization problem) and 
the output (an optimal solution if it exists) . In the context of linear mixed- 
integer optimization, this is straightforward: Seldom are we concerned with 
irrational objective functions or constraints; when we restrict the input to 
be rational as is usual, then also optimal solutions will be rational. 

This is no longer true even in the easiest cases of nonlinear optimiza- 
tion, as can be seen on the following quadratically constrained problem in 
one continuous variable: 

max f(x) = x A s.t. x 2 < 2. 

Here the unique optimal solution is irrational (x* = s/2, with f(x*) = 4), 
and so it docs not have a finite binary encoding. We ignore here the 
possibilities of using a model of computation and complexity over the real 
numbers, such as the celebrated Blum-Shub-Smale model [14]. In the 
familiar Turing model of computation, we need to resort to approximations. 

In the example above it is clear that for every e > 0, there exists a ra- 
tional x that is a feasible solution for the problem and satisfies |cc — re* | < e 
(proximity to the optimal solution) or \f(x) — f(x*)\ < e (proximity to the 
optimal value). However, in general we cannot expect to find approxima- 
tions by feasible solutions, as the following example shows. 

max f{x) = x s.t. x 3 — 2x = 0. 

(Again, the optimal solution is x = but the closest rational feasible 
solution is x = 0.) Thus, in the general situation, we will have to use the 
following notion of approximation: 

Definition 2.1. An algorithm A is said to efficiently approximate 
an optimization problem if, for every value of the input parameter e > 0, 
it returns a rational vector x (not necessarily feasible) with ||x — x*| < e. 
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where x* is an optimal solution, and the running time of A is polynomial 
in the input encoding of the instance and in log 1/e. 

2.3. Approximation algorithms and schemes. The polynomial 
dependence of the running time in log 1 /e, as defined above, is a very strong 
requirement. For many problems, efficient approximation algorithms of 
this type do not exist, unless P = NP. The following, weaker notions of 
approximation are useful; here it is common to ask for the approximations 
to be feasible solutions, though. 

Definition 2.2. 

(a) An algorithm A is an e-approximation algorithm for a maximization 
problem with optimal cost / max , if for each instance of the problem 
of encoding length n, A runs in polynomial time in n and returns a 
feasible solution with cost f^, such that 

fA > (1 - C) ■ /max- (2.1) 

(b) A family of algorithms A e is a polynomial time approximation scheme 
(PTAS) if for every error parameter e > 0, A e is an e-approximation 
algorithm and its running time is polynomial in the size of the instance 
for every fixed e. 

(c) A family {A e } e of e-approximation algorithms is a fully polynomial 
time approximation scheme (FPTAS) if the running time of A e is poly- 
nomial in the encoding size of the instance and 1/e. 

These notions of approximation are the usual ones in the domain of 
combinatorial optimization. It is clear that they are only useful when the 
function / (or at least the maximal value / max ) are non-negative. For 
polynomial or general nonlinear optimization problems, various authors 
[ni[T7J[SS] have proposed to use a different notion of approximation, where 
we compare the approximation error to the range of the objective function 
on the feasible region, 

| fA /max | — ^|/max /min • (2-2) 

(Here / m i n denotes the minimal value of the function on the feasible re- 
gion.) It enables us to study objective functions that are not restricted to 
be non-negative on the feasible region. In addition, this notion of approxi- 
mation is invariant under shifting of the objective function by a constant, 
and under exchanging minimization and maximization. On the other hand, 
it is not useful for optimization problems that have an infinite range. We 
remark that, when the objective function can take negative values on the 
feasible region, (|2.2|) is weaker than (|2.1|) . We will call approximation al- 
gorithms and schemes with respect to this notion of approximation weak. 
This terminology, however, is not consistent in the literature; |16j . for in- 
stance, uses the notion (|2.2p without an additional attribute and instead 
reserves the word weak for approximation algorithms and schemes that give 
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a guarantee on the absolute error: 

|./U-/max| <£■ (2.3) 

3. Incomputability. Before we can even discuss the computational 
complexity of nonlinear mixed-integer optimization, we need to be aware 
of fundamental incomputability results that preclude the existence of any 
algorithm to solve general integer polynomial optimization problems. 

Hilbcrt's tenth problem asked for an algorithm to decide whether 
a given multivariate polynomial p(xi, . . . , x n ) has an integer root, i.e., 
whether the Diophantinc equation 

p(xi,...,x n ) =0, xi,...,x n eZ (3.1) 

is solvable. It was answered in the negative by Matiyasevich based 
on earlier work by Davis, Putnam, and Robinson; see also [H]. A short 
self-contained proof, using register machines, is presented in [39] . 
Theorem 3.1. 

(i) There does not exist an algorithm that, given polynomials Pi, ■ ■ ■ ,p m , 
decides whether the system pi(x\, x n ) = 0, i = l,...,m, has a 
solution over the integers. 

(ii) There does not exist an algorithm that, given a polynomial p, decides 
whether p(xi, . . . , x n ) = has a solution over the integers. 

(hi) There does not exist an algorithm that, given a polynomial p, decides 
whether p(xi, . . . , x n ) = has a solution over the non-negative inte- 
gers Z+ = {0,1,2,...}. 

(iv) There does not exist an algorithm that, given a polynomial p, decides 
whether p(xi, ... ,x n ) = has a solution over the natural numbers 
N = {1,2,...}. 

These three variants of the statement are easily seen to be equivalent. 
The solvability of the system Pi(x\, . . . , x n ) = 0, i = 1, . . . , m, is equivalent 
to the solvability of Y^iL\ Pii x ii ■ ■ ■ > x n) = 0. Also, if (xi, . . . , x n ) € Z" 
is a solution of p(x\, . . . ,x n ) = over the integers, then by splitting vari- 
ables into their positive and negative parts, yi = max{0,Xi} and zi = 
max{0, — Xi}, clearly (yi, z±; . . . ; y n , z n ) is a non-negative integer solution of 
the polynomial equation q(yi,zi; . . . ; y n , z n ) := p(yi -zi,...,y n - z n ) = 0. 
(A construction with only one extra variable is also possible: Use the non- 
negative variables w = max{|xi| : Xi < 0} and j/j := xi + w.) In the other 
direction, using Lagrange's four-square theorem, any non-negative integer x 
can be represented as the sum a 2 + b 2 + c 2 + d 2 with integers a, b, c, d. Thus, 
if (x\, . . . , x n ) G is a solution over the non-negative integers, then there 
exists a solution (oi, b\, ci, d\ \ . . . ; a n , b n , Cn, d n ) of the polynomial equation 
r(ai,6i,ci,di; . . . ; a n ,b n , c„, d n ) := p(a\ +b\ +cf +d\ , . . . , a\ + b 2 n + c 2 n + d 2 n ). 
The equivalence of the statement with non-negative integers and the one 
with the natural numbers follows from a simple change of variables. 



COMPLEXITY OF NONLINEAR MIXED-INTEGER OPTIMIZATION 



■5 



Sharper statements of the above incomputability result can be found 
in [35]. All incomputability statements appeal to the classic result by Tur- 
ing [S3] on the existence of recursively enumerable (or listable) sets of natu- 
ral numbers that are not recursive, such as the halting problem of universal 
Turing machines. 

Theorem 3.2. For the following universal pairs (v,5) 

(58, 4), . . . , (38, 8), . . . , (21, 96), . . . , (14, 2.0 x 10 5 ), . . . , (9, 1.638 x 10 45 ), 

there exists a universal polynomial U(x; z, u, y; ai, . . . , a v ) of degree S in 
4 + v variables, i.e., for every recursively enumerable (listable) set X there 
exist natural numbers z, u, y, such that 

x <E X 3ai, . . . , a v S N : U(x; z, u, y\ a%, . . . , a v ) = 0. 

Jones explicitly constructs these universal polynomials, using and extend- 
ing techniques by Matiyasevich. Jones also constructs an explicit system of 
quadratic equations in 4 + 58 variables that is universal in the same sense. 
The reduction of the degree, down to 2, works at the expense of introducing 
additional variables; this technique goes back to Skolem j62) . 

In the following, we highlight some of the consequences of these re- 
sults. Let U be a universal polynomial corresponding to a universal pair 
(y, 8), and let X be a recursively enumerable set that is not recursive, i.e., 
there does not exist any algorithm (Turing machine) to decide whether 
a given x is in X. By the above theorem, there exist natural numbers 
z, u, y such that x £ X holds if and only if the polynomial equation 
U (x; z, u, y; oi, . . . , a v ) = has a solution in natural numbers oi, . . . , a v 
(note that x and z,u,y are fixed parameters here). This implies: 

Theorem 3.3. 

(i) Let (u, 5) be any of the universal pairs listed above. Then there does 
not exist any algorithm that, given a polynomial p of degree at most S 
in v variables, decides whether p(x\, . . . ,x n ) = has a solution over 
the non-negative integers. 

(ii) In particular, there does not exist any algorithm that, given a polyno- 
mial p in at most 9 variables, decides whether p(x\, ...,x n ) = has 
a solution over the non-negative integers. 

(iii) There also does not exist any algorithm that, given a polynomial p in 
at most 36 variables, decides whether p[x\, . . . , x n ) = has a solution 
over the integers. 

(iv) There does not exist any algorithm that, given a polynomial p of degree 
at most 4, decides whether p{x\, . . . ,x n ) = has a solution over the 
non-negative integers (or over the integers). 

(v) There does not exist any algorithm that, given a system of quadratic 
equations in at most 58 variables, decides whether it has a solution of 
the non-negative integers. 
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(vi) There does not exist any algorithm that, given a system of quadratic 
equations in at most 232 variables, decides whether it has a solution 
of the integers. 

We remark that the bounds of 4 x 9 = 36 and 4 x 58 = 232 are most 
probably not sharp; they are obtained by a straightforward application of 
the reduction using Lagrange's theorem. 

For integer polynomial optimization, this has the following fundamen- 
tal consequences. First of all, Theorem 13.31 can be understood as a state- 
ment on the feasibility problem of an integer polynomial optimization prob- 
lem. Thus, the feasibility of an integer polynomial optimization problem 
with a single polynomial constraint in 9 non-negative integer variables or 
36 free integer variables is undecidable, etc. 

If we wish to restrict our attention to feasible optimization problems, 
we can consider the problem of minimizing p 2 (x\, . . . ,x n ) over the inte- 
gers or non-negative integers and conclude that unconstrained polynomial 
optimization in 9 non-negative integer or 36 free integer variables is unde- 
cidable. We can also follow Jeroslow [37] and associate with an arbitrary 
polynomial p in n variables the optimization problem 



This optimization problem is always feasible and has the optimal solution 
value if and only if p{x\, . . . , x n ) = is solvable, and 1 otherwise. Thus, 
optimizing linear forms over one polynomial constraint in 10 non-negative 
integer variables is incomputable, and similar statements can be derived 
from the other universal pairs above. Jeroslow |37| used the above program 
and a degree reduction (by introducing additional variables) to prove the 
following. 

Theorem 3.4. The problem of minimizing a linear form over quadratic 
inequality constraints in integer variables is not computable; this still holds 
true for the subclass of problems that are feasible, and where the minimum 
value is either or 1. 

This statement can be strengthened by giving a bound on the number 
of integer variables. 

4. Hardness and inapproximability. All incomputability results, 
of course, no longer apply when finite bounds for all variables are known; 
in this trivial enumeration approach gives a finite algorithm. This 

is immediately the case when finite bounds for all variables are given in the 
problem formulation, such as for 0-1 integer problems. 

For other problem classes, even though finite bounds are not given, it is 
possible to compute such bounds that either hold for all feasible solutions or 
for an optimal solution (if it exists). This is well-known for the case of linear 



mm 



u 



s.t. (l-u)-p(xi,..., 
uez + , xeZ'j 



x„) = o, 



COMPLEXITY OF NONLINEAR MIXED-INTEGER OPTIMIZATION 



7 



constraints, where the usual encoding length estimates of basic solutions 
are available. As we explain in section 16.21 below, such finite bounds 
can also be computed for convex and quasi-convex integer optimization 
problems. 

In other cases, algorithms to decide feasibility exist even though no 
finite bounds for the variables are known. An example is the case of single 
Diophantinc equations of degree 2, which are dccidablc using an algorithm 
by Siegel [BT]. We discuss the complexity of this case below. 

Within any such computable subclass, we can ask the question of the 
complexity. Below we discuss hardness results that come from the number 
theoretic side of the problem (section |4~T|) and those that come from the 
continuous optimization side (section 14.21 

4.1. Hardness results from quadratic Diophantine equations 
in fixed dimension. The computational complexity of single quadratic 
Diophantinc equations in 2 variables is already very interesting and rich in 
structure; we refer to to the excellent paper by Lagarias Below we 

discuss some of these aspects and their implications on optimization. 

Testing primality of a number N is equivalent to deciding feasibility 
of the equation 

(x + 2)(y + 2) = N (4.1) 

over the non-negative integers. Recently, Agrawal, Kayal, and Saxena [5] 
showed that primality can be tested in polynomial time. However, the 
complexity status of finding factors of a composite number, i.e., finding a 
solution (x,y) of (|4.1[) . is still unclear. 

The class also contains subclasses of NP-complete feasibility problems, 
such as the problem of deciding for given a, f3, 7 G N whether there exist 
x±,X2 € with ax 2 + ftx2 = 7 |47j . On the other hand, the problem of 
deciding for given a, c 6 N whether there exist 11,12 6 Z with ax\X2 + X2 — 
c, lies in NP \ coNP unless NP = coNP pQ. 

The feasibility problem of the general class of quadratic Diophantine 
equations in two (non-negative) variables was shown by Lagarias [43] to 
be in NP. This is not straightforward because minimal solutions can have 
an encoding size that is exponential in the input size. This can be seen 
in the case of the so-called anti-Pellian equation x 2 — dy = — 1. Here 
Lagarias [H] proved that for all d = 5 2n+1 , there exists a solution, and the 
solution with minimal binary encoding length has an encoding length of 
f2(5") (while the input is of encoding length 0(n)). (We remark that the 
special case of the anti-Pellian equation is in coNP, as well.) 

Related hardness results include the problem of quadratic congruences 
with a bound, i.e., deciding for given a,6,c£N whether there exists a pos- 
itive integer x < c with x 2 = a (mod 6); this is the NP-complete problem 
AN1 in [25]. 
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From these results, we immediately get the following consequences on 
optimization. 

Theorem 4.1. 

(i) The feasibility problem of quadratically constrained problems inn = 1 
integer variables is NP-complete. 

(ii) The problems of computing a feasible (or optimal) solution of quadrat- 
ically constrained problems inn = 2 integer variables is not polynomial- 
time solvable (because the output may require exponential space). 

(hi) The feasibility problem of quadratically constrained problems in n > 2 
integer variables is NP-hard (but it is unknown whether it is in NP). 

(iv) The problem of minimizing a degree-A polynomial over the lattice 
points of a convex polygon ( dimension n = 2 ) is NP-hard. 

(v) The problem of finding the minimal value of a degree-A polynomial 
over Zj_ is NP-hard; writing down an optimal solution cannot be done 
in polynomial time. 

However, the complexity of minimizing a quadratic form over the in- 
teger points in polyhedra of fixed dimension is unclear, even in dimen- 
sion n — 2. Consider the integer convex minimization problem 

min ax\ + (3x2, 

S.t. Xl,X2 € Z + 

for a, P € N. Here an optimal solution can be obtained efficiently, as we 
explain in section 16.21 in fact, clearly x\ = xq, — is the unique optimal 
solution. On the other hand, the problem whether there exists a point 
{x\, x%) of a prescribed objective value 7 = ax\ + (5x2 is NP-complete (see 
above). For indefinite quadratic forms, even in dimension 2, nothing seems 
to be known. 

In varying dimension, the convex quadratic maximization case, i.e., 
maximizing positive definite quadratic forms is an NP-hard problem. This 
is even true in very restricted settings such as the problem to maximize 
Y,i (w 4 T x) 2 over x e {0, 1}" [53]. 

4.2. Inapproximability of nonlinear optimization in varying 
dimension. Even in the pure continuous case, nonlinear optimization is 
known to be hard. Bellare and Rogaway 0[T^ proved the following inap- 
proximability results using the theory of interactive proof systems. 

Theorem 4.2. Assume that P ^ NP. 

(i) For any e < ^, there does not exist a polynomial-time weak e- approximation 
algorithm for the problem of ( continuous ) quadratic programming over 
polytopes. 

(ii) There exists a constant S > such that the problem of polynomial 
programming over polytopes does not have a polynomial-time weak 
(1 — n~ s ) -approximation algorithm. 

Here the number 1 — n~ s becomes arbitrarily close to for growing n; 
note that a weak 0-approximation algorithm is one that gives no guarantee 
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other than returning a feasible solution. 

Inapproximability still holds for the special case of minimizing a quadratic 
form over the cube [— 1, 1]" or over the standard simplex. In the case of 
the cube, inapproximability of the max-cut problem is used. In the case 
of the standard simplex, it follows via the celebrated Motzkin-Straus the- 
orem [51] from the inapproximability of the maximum stable set problem. 
These are results by Hastad [28]; see also |16j . 

5. Approximation schemes. For important classes of optimization 
problems, while exact optimization is hard, good approximations can still 
be obtained efficiently. 

Many such examples are known in combinatorial settings. As an ex- 
ample in continuous optimization, we refer to the problem of maximizing 
homogeneous polynomial functions of fixed degree over simplices. Here de 
Klerk et al. [H] proved a weak PTAS. 

Below we present a general result for mixed-integer polynomial opti- 
mization over polytopcs. 

5.1. Mixed-integer polynomial optimization in fixed dimen- 
sion over linear constraints: FPTAS and weak FPTAS. Here we 
consider the problem 



where A is a rational matrix and b is a rational vector. As we pointed 
out above fTheorem l4.ip . optimizing degrec-4 polynomials over problems 
with two integer variables (ni = 0, ni = 2) is already a hard problem. 
Thus, even when we fix the dimension, we cannot get a polynomial-time 
algorithm for solving the optimization problem. The best we can hope for, 
even when the number of both the continuous and the integer variables is 
fixed, is an approximation result. 

We present here the FPTAS obtained by De Loera et al. [TBH2T)] . which 
uses the "summation method" and the theory of short rational generating 
functions pioneered by Barvinok [6l[7]. We review the methods below; the 
FPTAS itself appears in Section l5.1.3l An open question is briefly discussed 
at the end of this section. 

5.1.1. The summation method. The summation method for opti- 
mization is the idea to use of elementary relation 



which holds for any finite set S = {s\, . . . , sn} of non-negative real num- 
bers. This relation can be viewed as an approximation result for 4-norms. 



max/min f(xi,...,x n ) 
subject to Ax < b 

x e R ni x Z" 2 , 



(5.1) 




(5.2) 
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Fig. 1. Approximation properties of £ k -norms 



Now if P is a polytope and / is an objective function non-negative on 
P D Z d , let x 1 , . . . , x N denote all the feasible integer solutions in P n If 1 
and collect their objective function values Sj = /(x 4 ) in a vector s £ Q N . 
Then, comparing the unit balls of the £fc-norm and the ^oo-norm (FigureQJ, 
we get the relation 

L k := JV-^HslU < l|s||oo < ||s|U =: C^fc- 

These estimates are independent of the function /. (Different estimates 
that make use of the properties of /, and that are suitable also for the 
continuous case, can be obtained from the Holder inequality; see for in- 
stance [3].) 

Thus, for obtaining a good approximation of the maximum, it suffices 
to solve a summation problem of the polynomial function h = f k on PnZ d 
for a value of k that is large enough. Indeed, for k = + 1/e) log iV] , 
we obtain Uk — Pk < e/(x max ). On the other hand, this choice of k is 
polynomial in the input size (because 1/e is encoded in unary in the input, 
and log N is bounded by a polynomial in the binary encoding size of the 
polytope P). Hence, when the dimension d is fixed, we can expand the 
polynomial function f k as a list of monomials in polynomial time. 

5.1.2. Rational generating functions. To solve the summation 
problem, one uses the technology of short rational generating functions. 
We explain the theory on a simple, one-dimensional example. Let us con- 
sider the set 5 of integers in the interval P = [0, . . . , n] . We associate with S 
the polynomial g(P; z) = z° + z 1 + ■ ■ ■ + z' l_1 + z n ; i.e., every integer a £ S 
corresponds to a monomial z a with coefficient 1 in the polynomial g(P; z). 
This polynomial is called the generating function of S (or of P) . From the 
viewpoint of computational complexity, this generating function is of expo- 
nential size (in the encoding length of n), just as an explicit list of all the 
integers 0, 1, . . . , n — 1, n would be. However, we can observe that g(P] z) 
is a finite geometric series, so there exists a simple summation formula that 
expresses it in a much more compact way: 

1 _ 7 n+l 

g(P; z) = z° + Z 1 + ■■■ + z"- 1 + z n = . (5.3) 

The "long" polynomial has a "short" representation as a rational function. 
The encoding length of this new formula is linear in the encoding length 
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of n. On the basis of this idea, we can solve the summation problem. 
Consider the generating function of the interval P — [0, 4], 



g(P; z) = z° + z 1 + z 2 + z 3 + z 4 



1 



1-z l-z 

We now apply the differential operator z-$- and obtain 



dz 



z—)g(P;z) = lz 1 + 2z 2 



3z J 



4z 4 = 



1 



-4z 5 + 5z 4 



(l-z) 2 [l-zf 



Applying the same differential operator again, we obtain 



g{P;z) = Iz 1 + 4z 2 



9z 3 + 16z 4 
z + z 2 25z 5 - 39z 6 + 16z 7 



(1 



\3 



(1-Zf 



We have thus evaluated the monomial function h(a) = a 2 for a = 0, . . . , 4; 
the results appear as the coefficients of the respective monomials. Substi- 
tuting z = 1 yields the desired sum 



= 1 + 4 + 9 + 16 = 30 



dz 



dz 



The idea now is to evaluate this sum instead by computing the limit of the 
rational function for z — > 1, 



E 

o=0 



a" = lim 



z + z 2 25z 5 - 39z b + I62 ' 

(1-Z) 3 (1-Z) 3 



this can be done using residue techniques. 

We now present the general definitions and results. Let P C R d be a 
rational polyhedron. We first define its generating function as the formal 
Laurent series g(P;z) = EaePnz" z " e %ll z i, ■ ■ ■ > z d, zf\ . . . , z~ i.e., 
without any consideration of convergence properties. By convergence, one 
moves to a rational generating function g(P; z) g Q(zi, ■ • ■ , Zd). 

The following breakthrough result was obtained by Barvinok in 1994. 

Theorem 5.1 (Barvinok [6]). Let d be fixed. There exists a polynomial- 
time algorithm for computing the generating function g(P; z) of a polyhe- 
dron P C R d given by rational inequalities in the form of a rational function 



with a € {±1}, &i € Z d , and b. y e Z° 



iei 



(5.4) 
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5.1.3. Efficient summation using rational generating functions. 

Below we describe the theorems on the summation method based on short 
rational generating functions, which appeared in [T51 - I2T)] . Let g(P;z) be 
the rational generating function of P n Z d , computed using Barvinok's al- 
gorithm. By symbolically applying differential operators to g(P; z), we can 
compute a short rational function representation of the Laurent polynomial 
g(P,h;z) = J2aePnz d h(ot)z a , where each monomial z a corresponding to 
an integer point a <G PnZ d has a coefficient that is the value h(a). As 
in the one-dimensional example above, we use the partial differential op- 
erators Zi ^7 for i = 1, . . . , d on the short rational generating function. In 
fixed dimension, the size of the rational function expressions occuring in 
the symbolic calculation can be bounded polynomially. Thus one obtains 
the following result. 

Theorem 5.2 ( [19], Lemma 3.1). 
(a) Let h(xi, . . . , Xd) = J2p c p x>3 G Q[ x ii ■ ■ ■ > x d] be a polynomial. Define 

the differential operator 




Then D% maps the generating function g(P;z) = X)c*ePnz d z " ^° ^ e 
weighted generating function (Dhg)(z) = g(P,h;z) = X) a ePnz d h{a)z a 
(b) Let the dimension d be fixed. Let g(P; z) be the Barvinok representation 
of the generating function ^2 aePnZd z a ofPV\1f l . Let h € Q[xi, . . . , Xd] 
be a polynomial, given as a list of monomials with rational coeffi- 
cients c/3 encoded in binary and exponents (3 encoded in unary. We 
can compute in polynomial time a Barvinok representation g(P, h; z) 
for the weighted generating function X^aePnz 1 ' h( a ) z<x ■ 
Thus, we can implement the following algorithm in polynomial time 
(in fixed dimension). 

Algorithm 1 (Computation of bounds for the optimal value). 
Input: A rational convex polytope P C M. d ; a polynomial objective func- 
tion f <E Q[xi, . . . ,Xd] that is non-negative over P n Z d , given as a list of 
monomials with rational coefficients cp encoded in binary and exponents (3 
encoded in unary; an index k, encoded in unary. 

Output: A lower bound L^ and an upper bound Uk for the maximal function 
value f* of f over PC\7L d . The bounds Lk form a nondecr easing, the bounds 
Uk a nonincreasing sequence of bounds that both reach f* in a finite number 
of steps. 

1. Compute a short rational function expression for the generating function 
g(P]z) = X)aGPnz dZa - Using residue techniques, compute \P C\7L d \ = 
g(P; 1) from g(P;z). 

2. Compute the polynomial f k from f . 

3. From the rational function g(P; z) compute the rational function rep- 
resentation of g(P, / fc ;z) of ^2 aePnZ d f k (a)z a by Theorem \5.2\ Using 
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residue techniques, compute 



tfg(P,P;l)/g(P;l) and U k := tfg(P,P;l) 



From the discussion of the convergence of the bounds, one then obtains 
the following result. 

Theorem 5.3 (Fully polynomial-time approximation scheme). Let 
the dimension d be fixed. Let P C M. d be a rational convex polytope. Let f 
be a polynomial with rational coefficients that is non-negative on P n 
given as a list of monomials with rational coefficients cp encoded in binary 
and exponents (3 encoded in unary. 
(i) Algorithm^ computes the bounds Lk, Uk in time polynomial in k, the 
input size of P and f , and the total degree D. The bounds satisfy 



(ii) For k = (1 + 1/e) log(|P PI (a number bounded by a polynomial in 
the input size), Lk is a (1 — e)- approximation to the optimal value f* 
and it can be computed in time polynomial in the input size, the total 
degree D, and 1/e. Similarly, Uk gives a (1 + e)- approximation to f*. 

(hi) With the same complexity, by iterated bisection of P , we can also find 
a feasible solution x e £ P H Z d with |/(x e ) — /* < ef*. 

5.1.4. Extension to the mixed-integer case by discretization. 

The mixed-integer case can be handled by discretization of the continuous 
variables. We illustrate on an example that one needs to be careful to pick 
a sequence of discretizations that actually converges. Consider the mixed- 
integer linear optimization problem depicted in Figure [2j whose feasible 
region consists of the point (i 1) and the segment { (x, 0) : x G [0, 1] }. 
The unique optimal solution is x = ^ z = 1. Now consider the sequence 
of grid approximations where x £ — Z>o- For even m, the unique optimal 

771 — 

solution to the grid approximation is x = |, z = 1. However, for odd m, 
the unique optimal solution is x = 0, z = 0. Thus the full sequence of the 
optimal solutions to the grid approximations does not converge because it 
has two limit points; see Figure [2] 

To handle polynomial objective functions that take arbitrary (posi- 
tive and negative) values, one can shift the objective function by a large 
constant. Then, to obtain a strong approximation result, one iteratively 
reduces the constant by a factor. Altogether we have the following result. 

Theorem 5.4 (Fully polynomial-time approximation schemes). Let 
the dimension n = n\ + ri2 be fixed. Let an optimization problem (|5.1I) of 
a polynomial function f over the mixed-integer points of a polytope P and 
an error bound e be given, where 

(11 ) / is given as a list of monomials with rational coefficients cp encoded 
in binary and exponents (3 encoded in unary, 

(12) P is given by rational inequalities in binary encoding, 

(13) the rational number - is given in unary encoding. 
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Fig. 2. A mixed-integer linear optimization problem and a sequence of optimal 
solutions to grid problems with two limit points, for even m and for odd m 

(a) There exists a fully polynomial time approximation scheme (FPTAS) for 
the maximization problem for all polynomial functions /(x, z) that are 
non-negative on the feasible region. That is, there exists a polynomial- 
time algorithm that, given the above data, computes a feasible solution 
(x e ,z e ) e PC] (R" 1 x Z" 2 ) with 

|/(-^e; 2 e ) ,/*(x max , Z max ) | ef (x max , Z max ) . 

(b) There exists a polynomial-time algorithm that, given the above data, 
computes a feasible solution (x e ,z £ ) G Pfl (R" 1 x Z" 2 ) with 

|^(x e ,Z e ) ,/*(x max , Z max ) | 6 1 ,/(x max , Z max ) /(x m j n , Z m j n ) | . 

In other words, this is a weak FPTAS. 

5.1.5. Open question. Consider the problem (|5.1[) for a fixed num- 
ber ri2 of integer variables and a varying number n\ of continuous variables. 
Of course, even with no integer variables present (ri2 = 0), this is NP-hard 
and inapproximable. On the other hand, if the objective function / is 
linear, the problem can be solved in polynomial time using Lenstra's al- 
gorithm. Thus it is interesting to consider the problem for an objective 
function of restricted nonlinearity, such as 

/( x , z ) = s( z ) +c T x, 

with an arbitrary polynomial function g in the integer variables and a 
linear form in the continuous variables. The complexity (in particular the 
existence of approximation algorithms) of this problem is an open question. 

6. Polynomial-time algorithms. Here we study important special 
cases where polynomial-time algorithms can be obtained. We also include 
cases here where the algorithms efficiently approximate the optimal solution 
to arbitrary precision, as discussed in section 12.21 
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6.1. Fixed dimension: Continuous polynomial optimization. 

Here we consider pure continuous polynomial optimization problems of the 
form 

min f{xi,...,x n ) 
s.t. gi(xi,. . .,x n ) < 

: (6.1) 

g m {x\,...,x n ) < 
x g R ni . 

When the dimension is fixed, this problem can be solved in polynomial 
time, in the sense that there exists an algorithm that efficiently computes 
an approximation to an optimal solution. This follows from a much more 
general theory on the computational complexity of approximating the solu- 
tions to general algebraic and semialgebraic formulae over the real numbers 
by Renegar [60] , which we review in the following. The bulk of this theory 
was developed in [57l-l59l . Similar results appeared in [29] ; see also Chap- 
ter 14]). One considers problems associated with logic formulas of the form 

Qxx 1 G R ni : ... Q„x w G R"- : P(y, x 1 , . . . , x") (6.2) 

with quantifiers G {3, V}, where P is a Boolean combination of polyno- 
mial inequalities such as 

5»(y, x \ ■ • ■ 7 X ") < 0, i = l,...,m, 

or using >, <, >, or = as the relation. Here y G R™° is a free (i.e., not 
quantified) variable. Let d > 2 be an upper bound on the degrees of the 
polynomials gi. A vector y e K™° is called a solution of this formula if 
the formula (|6.2[) becomes a true logic sentence if we set y = y. Let Y 
denote the set of all solutions. An e-approximate solution is a vector y e 
with || y — y e || < e for some solution yeF. 

The following bound can be proved. When the number u> of "blocks" 
of quantifiers (i.e., the number of alternations of the quantifiers 3 and V) 
is fixed, then the bound is singly exponential in the dimension. 

Theorem 6.1. If the formula (|6.2[) has only integer coefficients of 
binary encoding size at most £, then every connected component of Y in- 
tersects with the ball {||y|| < r}, where 

logr = e{md) 2 ° { " )noni - nk . 

This bound is used in the following fundamental result, which gives a 
general algorithm to compute e-approximate solutions to the formula (|6.2[) . 

Theorem 6.2. There exists an algorithm that, given numbers < e < 
r that are integral powers of 2 and a formula (|6.2[) . computes a set {yi}i of 



16 



MATTHIAS KOPPE 



(md) 2 no«i - "fc distinct e- approximate solutions of the formula with the 
property that for each connected components of Y D {||y|| < r} one of the 
Yi is within distance e. The algorithm runs in time 

(md) 2 ° { ^ noni - nk (l + md + log \ + logr)° (1) . 

This can be applied to polynomial optimization problems as follows. 
Consider the formula 

Vxel" 1 : 5l (y) <0 A ••• A g m (y) <0 

A [ 5l (x) > V • • • V 5m (x) > V /(y) - /(x) < 0], 

(6.3) 

this describes that y is an optimal solution (all other solutions x are either 
infeasible or have a higher objective value) . Thus optimal solutions can be 
efficiently approximated using the algorithm of Theorem 16.21 

6.2. Fixed dimension: Convex and quasi-convex integer poly- 
nomial minimization. In this section we consider the case of the mini- 
mization of convex and quasi-convex polynomials / over the mixed-integer 
points in convex regions given by convex and quasi-convex polynomial func- 
tions gi, ...,g m : 

min f(xx,...,x n ) 
s.t. gi(x±, ...,x n )<0 

: (6.4) 

g m {xi, . ..,x n ) < 
x e R" 1 x Z" 2 , 

Here a function g : M" — s- M 1 is called quasi-convex if every lower level set 
L\ = { x e E" : g(x) < A } is a convex set. 

The complexity in this setting is fundamentally different from the gen- 
eral (non-convex) case. One important aspect is that bounding results for 
the coordinates of optimal integer solutions exists, which are similar to 
the ones for continuous solutions in Theorem 16.11 above. For the case of 
convex functions, these bounding results were obtained by [40j|63j . An im- 
proved bound was obtained by [4j[5] , which also handles the more general 
case of quasi-convex polynomials. This bound follows from the efficient 
theory of quantifier elimination over the real numbers that we referred to 
in section IB~T1 

Theorem 6.3. Let f,gx,..., g m € Z[xi, . . . , x n ] be quasi-convex poly- 
nomials of degree at most d > 2, whose coefficients have a binary encoding 
length of at most i. Let 



F = { x € l n : ffj(x) < fori=l,...,m} 
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Fig. 3. Branching on hyperplanes corresponding to approximate lattice width di- 
rections of the feasible region in a Lenstra-type algorithm 

be the (continuous) feasible region. If the integer minimization problem 
min{ /(x) : x £ FnZ" } is bounded, there exists a radius R e Z + of binary 
encoding length at most (m d)°( n h such that 

min{ /(x) : x £ F n Z" } = min{ /(x) :x£Ffl Z", ||x|| < i? }. 

Using this finite bound, a trivial enumeration algorithm can find an 
optimal solution (but not in polynomial time, not even in fixed dimen- 
sion) . Thus the incomputability result for integer polynomial optimization 
(Theorem 13. 3[) does not apply to this case. 

The unbounded case can be efficiently detected in the case of quasi- 
convex polynomials; see [5] and [52], the latter of which also handles the 
case of "faithfully convex" functions that are not polynomials. 

In fixed dimension, the problem of convex integer minimization can be 
solved efficiently using variants of Lenstra's algorithm [46] for integer pro- 
gramming. Lenstra-type algorithms are algorithms for solving feasibility 
problems. We consider a family of feasibility problems associated with the 
optimization problem, 

3x e F a n Z" where F a = { x e F : /(x) < a } for a g Z. (6.5) 

If bounds for /(x) on the feasible regions of polynomial binary encoding 
size are known, a polynomial time algorithm for this feasibility problem can 
be used in a binary search to solve the optimization problem in polynomial 
time. Indeed, when the dimension n is fixed, the bound R given by Theorem 
16.31 has a binary encoding size that is bounded polynomially by the input 
data. 

A Lenstra-type algorithm uses branching on hyperplanes (Figure [3]) to 
obtain polynomial time complexity in fixed dimension. Note that only the 
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binary encoding size of the bound i?, but not R itself, is bounded polyno- 
mially. Thus, multiway branching on the values of a single variable Xi will 
create an exponentially large number of subproblems. Instead, a Lenstra- 
type algorithm computes a primitive lattice vector w £ Z" such that there 
are only few lattice hyperplanes w T x = 7 (with 7 £ Z) that can have a 
nonempty intersection with F a . The width of F a in the direction w, defined 
as 

max{ w T x : x £ F a } — min{ w T x : x £ F a } (6-6) 

essentially gives the number of these lattice points. A lattice width direction 
is a minimizer of the width among all directions w £ Z™, the lattice width 
the corresponding width. Any polynomial bound on the width will yield a 
polynomial-time algorithm in fixed dimension. 

Exact and approximate lattice width directions w can be constructed 
using geometry of numbers techniques. We refer to the excellent tuto- 
rial [21] and the classic references cited therein. The key to dealing with 
the feasible region F a is to apply ellipsoidal rounding. By applying the 
shallow-cut ellipsoid method (which we describe in more detail below), one 
finds concentric proportional inscribed and circumscribed ellipsoids that 
differ by some factor /3 that only depends on the dimension n. Then 
any ^-approximate lattice width direction for the ellipsoids gives a f3rj- 
approximate lattice width direction for F a . Lenstra's original algorithm 
now uses an LLL-reduced basis of the lattice Z™ with respect to a norm 
associated with the ellipsoid; the last basis vector then serves as an approx- 
imate lattice width direction. 

The first algorithm of this kind for convex integer minimization was 
announced by Khachiyan |40j . In the following we present the variant 
of Lenstra's algorithm due to Heinz [3D], which seems to yield the best 
complexity bound for the problem published so far. The complexity result 
is the following. 

Theorem 6.4. Let f,gi,..., g m £ Z[ ] be quasi- convex poly- 

nomials of degree at most d > 2, whose coefficients have a binary en- 
coding length of at most I. There exists an algorithm running in time 
TO £0(i)^0(n) 2 0(n 3 ) that compu f es a minimizer x* £ Z" of the problem fO]) 
or reports that no minimizer exists. If the algorithm outputs a mini- 
mizer x* , its binary encoding size is £d°^. 

We remark that the complexity guarantees can be improved dramati- 
cally by combining Heinz' technique with more recent variants of Lenstra's 
algorithm that rely on the fast computation of shortest vectors [55] , 

A complexity result of greater generality was presented by Khachiyan 
and Porkolab [H] . It covers the case of minimization of convex polynomials 
over the integer points in convex semialgebraic sets given by arbitrary (not 
necessarily quasi-convex) polynomials. 
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Theorem 6.5. Let Y C W l ° be a convex set given by 

Y={yeR n " : Qix 1 G K" 1 : ••• Q u x" G R n " : P(y, x\ . . . , x") } 

with quantifiers Qi G {3, V}, where P is a Boolean combination of polyno- 
mial inequalities 

g i (y,ic 1 ,...,^ 3 )<0, i = l,...,m 

with degrees at mostd > 2 and coefficients of binary encoding size at most £. 
There exists an algorithm for solving the problem min{ y no : y G Y l~l Z n ° } 
m tame ^Wfmrf) '"^ n?=i 0(n 4 ). 

When the dimension no + ni + ■ — h ra^ is fixed, the algorithm runs in 
polynomial time. For the case of convex minimization where the feasible 
region is described by convex polynomials, the complexity bound of Theo- 
rem 16. 51 however, translates to (. ^m ^ n ^d°^ n which is worse than the 
bound of Theorem IQ1 [50]. 

In the remainder of this subsection, we describe the ingredients of 
the variant of Lenstra's algorithm due to Heinz. The algorithm starts out 
by "rounding" the feasible region, by applying the shallow-cut ellipsoid 
method to find proportional inscribed and circumscribed ellipsoids. It is 
well-known |26j that the shallow-cut ellipsoid method only needs an initial 
circumscribed ellipsoid that is "small enough" (of polynomial binary en- 
coding size - this follows from Theorem 16. 3|) and an implementation of a 
shallow separation oracle, which we describe below. 

For a positive-definite matrix A we denote by £(A,x) the ellipsoid 
{ x G MP : (x - x) T A(x - x) < 1 }. 

Lemma 6.1 (Shallow separation oracle). Let go, ■ ■ ■ , g m +i € <2[x] be 
quasi- convex polynomials of degree at most d, the binary encoding sizes of 
whose coefficients are at most r. Let the (continuous) feasible region F = 
{ x G M" : <?j(x) < } be contained in the ellipsoid £(A, x) ; where A and x 
have binary encoding size at most I. There exists an algorithm with running 
time m(lnr)°^ d°^ that outputs 

(a) "true" if 

£{{n + ir 3 Ax) C F C £(A,x); (6.7) 

(b) otherwise, a vector c G Q n \{0} of binary encoding length (/+r)((in) ^ 1 ' 
with 

F C £(A, x) n { x G K" : c T (x-x) < -^{c 1 Ac) 1 / 2 }. (6.8) 

Proof. We give a simplified sketch of the proof, without hard complex- 
ity estimates. By applying an afiine transformation to F C £(A, x), we 
can assume that F is contained in the unit ball £ (7, 0). Let us denote as 
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Fig. 4. The implementation of the shallow separation oracle, (a) Test points Xj, 
in the circumscribed ball £(1,0). (b) Case I: All test points x;i are (continuously) 
feasible; so their convex hull (a cross-polytope) and its inscribed ball £((n + 1)~ 3 , 0) are 
contained in the (continuous) feasible region F. 



usual by ei, . . . , e„ the unit vectors and by e„ + i, . . . , e.i n their negatives. 
The algorithm first constructs numbers A^i , . . . , > with 

— < A a < ■ ■ ■ < A^ < — — r (6.9) 
n + | Ti + l 

and the corresponding point sets Bi = { := A^e^ : j = l,..,,d}; 
see Figure H|(a). The choice of the bounds (|6.9p for Ay will ensure that 
we either find a large enough inscribed ball for (a) or a deep enough cut 
for (b). Then the algorithm determines the (continuous) feasibility of the 
center and the 2n innermost points x^i. 

Case I. If Xi i <G F for i = 1, . . . , 2n, then the cross-polytope conv{ x^i : 
i = l,...,2n} is contained in F; see Figure |4](b). An easy calculation 
shows that the ball £((n + 1)~ 3 , 0) is contained in the cross-polytope and 
thus in F; see Figure |U Hence the condition in (a) is satisfied and the 
algorithm outputs "true" . 

Case II. We now discuss the case when the center violates a poly- 
nomial inequality go( x ) < (say). Let F = { x G R n : #o( x ) < 0} D F. 
Due to convexity of Fq, for all i = 1, . . . , n, one set of each pair BitlFo and 
B n+ i n Fq must be empty; see Figure 0(a). Without loss of generality, let 
us assume B n+ i n Fq = for all i. We can determine whether a n-variate 
polynomial function of known maximum degree d is constant by evaluating 
it on (d + 1)" suitable points (this is a consequence of the Fundamental 
Theorem of Algebra). For our case of quasi-convex polynomials, this can 
be improved; indeed, it suffices to test whether the gradient Vgo vanishes 
on the nd points in the set B\ U- • • U B n . If it does, we know that go is con- 
stant, thus F = 0, and so can we return an arbitrary vector c. Otherwise, 
there is a point x^ € Bi with c := V<7o( x ij) 7^ 0; we return this vector as 
the desired normal vector of a shallow cut. Due to the choice of \j as a 
number smaller than the cut is deep enough into the ellipsoid £(A, x), 
so that MM holds. 



Case III. The remaining case to discuss is when 6 F but there exists 
a k € {1, . . . , 2n} with Xf. 1 ^ F. Without loss of generality, let k = 1, and 
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Fig. 5. The implementation of the shallow separation oracle, (a) Case II: The 
center violates a polynomial inequality go(x) < (say). Due to convexity, for all 
i = 1, . . . , n, one set of each pair Bif\F and B n +i f] F must be empty, (b) Case III: A 
test point x^i is infeasible, as it violates an inequality go( x ) < (say). However, the 
center is feasible at least for this inequality. 

let X14 violate the polynomial inequality go( x ) < 0, i.e., go( x i,i) > 0; see 
Figure [5](b). We consider the univariate polynomial 0(A) = g (\ei). We 
have (f>(0) = go(0) < and cf>(Xi t i) > 0, so <fr is not constant. Because <f> has 
degree at most d, its derivative <f>' has degree at most d—1, so 0' has at most 
d — 1 roots. Thus, for at least one of the d different values Ai.i, . . . , Ai i( j, 
say Aij, we must have (j)'(Xij) =/= 0. This implies that c := Vgo( x i.j) 7^ 0. 
By convexity, we have Xi.j ^ F, so we can use c as the normal vector of a 
shallow cut. □ 

By using this oracle in the shallow-cut ellipsoid method, one obtains 
the following result. 

Corollary 6.1. Let go, ■ ■ ■ ,g m G ^[ x ] be quasi- convex polynomials 
of degree at most d > 2. Let the (continuous) feasible region F = {x £ 
R™ : 5i(x) < } be contained in the ellipsoid £(Aq, 0), given by the positive- 
definite matrix Aq £ Q nxn . Let e £ Q>o be given. Let the entries of Aq 
and the coefficients of all monomials ofgo,...,g m have binary encoding 
size at most £. 

There exists an algorithm with running time m(£n)°^ dP^ that com- 
putes a positive-definite matrix A £ Q™ x ™ and a point x £ Q™ with 

(a) either £{{n + iy 3 A, x) C F C £(A, x) 

(b) orFC£(A,x) and vol£(A, x) < e. 

Finally, there is a lower bound for the volume of a continuous feasible 
region F that can contain an integer point. 

Lemma 6.2. Under the assumptions of Corollary 16'. 11 if F H Z" ^ 0, 
there exists an e £ Q>o of binary encoding size £(dn)°^ with vol F > e. 

On the basis of these results, one obtains a Lenstra-type algorithm for 
the decision version of the convex integer minimization problem with the 
desired complexity. By applying binary search, the optimization problem 
can be solved, which provides a proof of Theorem 16.41 

6.3. Fixed dimension: Convex integer maximization. Maxi- 
mizing a convex function over the integer points in a polytope in fixed 
dimension can be done in polynomial time. To see this, note that the op- 
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timal value is taken on at a vertex of the convex hull of all feasible integer 
points. But when the dimension is fixed, there is only a polynomial number 
of vertices, as Cook et al. [TS] showed. 

Theorem 6.6. Let P = {xeB": Ax < b } be a rational polyhedron 
with A € (Q) mxn and let </> be the largest binary encoding size of any of the 
rows of the system Ax. < b. Let P l = conv(PnZ ra ) be the integer hull of P. 
Then the number of vertices of P 1 is at most 2m n (6n 2 4>) n . Moreover, 
Hartmann |27| gave an algorithm for enumerating all the vertices, which 
runs in polynomial time in fixed dimension. 

By using Hartmann's algorithm, we can therefore compute all the ver- 
tices of the integer hull P 1 , evaluate the convex objective function on each of 
them and pick the best. This simple method already provides a polynomial- 
time algorithm. 

7. Strongly polynomial-time algorithms: Submodular func- 
tion minimization. In important specially structured cases, even strongly 
polynomial-time algorithms are available. The probably most well-known 
case is that of submodular function minimization. We briefly present the 
most recent developments below. 

Here we consider the important problem of submodular function min- 
imization. This class of problems consists of unconstrained 0/1 program- 
ming problems 

min/(x):xe{0,iy\ 

where the function / is submodular, i.e., 

/(*) + /(y) > /(max{x,y}) + /(min{x,y}). 

Here max and min denote the componentwise maximum and minimum of 
the vectors, respectively. 

The fastest algorithm known for submodular function minimization 
seems to be by Orlin |54) . who gave a strongly polynomial-time algorithm 
of running time 0(n 5 T ova i + n 6 ), where T eva i denotes the running time of 
the evaluation oracle. The algorithm is "combinatorial", i.e., it does not 
use the ellipsoid method. This complexity bound simultaneously improved 
that of the fastest strongly polynomial-time algorithm using the ellipsoid 
method, of running time 0(n 5 T OV ai + n 7 ) (see |50j ) and the fastest "com- 
binatorial" strongly polynomial-time algorithm by Iwata [35] , of running 
time 0((n 6 T eva i + n 7 ) logn). We remark that the fastest polynomial-time 
algorithm, by Iwata [35], runs in 0((n 4 T eva i + n 5 ) logM), where M is the 
largest function value. We refer to the recent survey by Iwata [36], who 
reports on the developments that preceded Orlin's algorithm |54j . 

For the special case of symmetric submodular function minimization, 
i.e., /(x) = /(l — x), Queyranne [56j presented an algorithm of running 
time 0(n 3 T eval ). 
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